Multimodal Human Machine Interactions in Virtual and Augmented Reality (v-dij-14)
نویسندگان
چکیده
Virtual worlds are developing rapidly over the Internet. They are visited by avatars and staffed with Embodied Conversational Agents (ECAs). An avatar is a representation of a physical person. Each person controls one or several avatars and usually receives feedback from the virtual world on an audio-visual display. Ideally, all senses should be used to feel fully embedded in a virtual world. Sound, vision and sometimes touch are the available modalities. This paper reviews the technological developments which enable audio-visual interactions in virtual and augmented reality worlds. Emphasis is placed on speech and gesture interfaces, including talking face analysis and synthesis.
منابع مشابه
Application of Augmented and Virtual Reality Technologies in Medicine
Background and Aim: Virtual Reality and Augmented Reality are immersive technologies that integrate virtual and real-world elements. These technologies have been used to help and improve human capabilities in many fields. Virtual and augmented systems are used in various medical situations. They are effective options in most stages of patient treatment and performing medical procedures. Therefo...
متن کاملMultimodal Human Machine Interactions in Virtual and Augmented Reality
Virtual worlds are developing rapidly over the internet. They are visited by avatars and staffed with Embodied Conversational Agents (ECAs). An avatar is a representation of a physical person. Each person controls one or several avatars and usually receives feedback from the virtual world on an audio-visual display. Ideally, all senses should be used to feel fully embedded in a virtual world. S...
متن کاملUser-driven Intelligent Interface on the Basis of Multimodal Augmented Reality and Brain-Computer Interaction for People with Functional Disabilities
The analysis of the current integration attempts of some modes and use cases of user-machine interaction is presented. The new concept of the user-driven intelligent interface is proposed on the basis of multimodal augmented reality and brain-computer interaction for various applications: in disabilities studies, education, home care, health care, etc. The several use cases of multimodal augmen...
متن کاملQualitative and Quantitative Crying Analysis of New Born Babies Delivered Under High Risk Gestation
Multimodal Human Machine Interactions in Virtual and Augmented Reality p. 1 Speech through the Ear, the Eye, the Mouth and the Hand p. 24 Multimodality Issues in Conversation Analysis of Greek TV Interviews p. 40 Representing Communicative Function and Behavior in Multimodal Communication p. 47 Using the iCat as Avatar in Remote Meetings p. 60 Using Context to Disambiguate Communicative Signals...
متن کاملWorkshop on Multi-sensorial Approaches to Human-food Interaction 1st Workshop on Multi-sensorial Approaches to Human-food Workshop on Multi-sensorial Approaches to Human-food Interaction Workshop on Multi-sensorial Approaches to Human-food Interaction the Association for Computing Machinery 2
In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-sensory feedbacks achieved a major breakthrough by utilizing cross-modal interactions. By changing sensory stimuli through only one modality using t...
متن کامل